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We consider a one-step replica symmetry breaking description of the Edwards-Anderson 
spin glass model in 2D. The ingredients of this description are a Kikuchi approximation 
to the free energy and a second-level statistical model built on the extremal points of the 
Kikuchi approximation, which are also fixed points of a Generalized Belief Propagation 
(GBP) scheme. We show that a generalized free energy can be constructed where these ex¬ 
tremal points are exponentially weighted by their Kikuchi free energy and a Parisi parameter 
y, and that the Kikuchi approximation of this generalized free energy leads to second-level, 
one-step replica symmetry breaking (IRSB), GBP equations. We then proceed analogously 
to Bet he approximation case for tree-like graphs, where it has been shown that IRSB Belief 
Propagation equations admit a Survey Propagation solution. We discuss when and how the 
one-step-replica symmetry breaking GBP equations that we obtain also allow a simpler class 
of solutions which can be interpreted as a class of Generalized Survey Propagation equations 
for the single instance graph case. 

I. INTRODUCTION 

Low-temperature phases of systems with random interactions can be thought of as optimizing 
under a large set of highly interdependent and conflicting constraints. If a local optimum has been 
found it will typically be difficult to improve upon without adjusting many variables over a large 
domain, which is inherently difficult, for any optimization procedure. A physical process obeying 
detailed balance will furthermore care not directly about how different are two configurations but 
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rather about how high are the energy barriers between them; for low enough temperature transition 
times should follow an Arrhenius law, rtransit ^ ^ where Tmicro is a (microscopic) 

attempt time, Eb is a barrier height and [3 = is the inverse temperature. If barrier heights 
increase with system size N different such low-lying states will be essentially disconnected for very 
long times (exponential in N)^ and the equilibrium Gibbs measure separates into a (weighted) sum 
over such states. 

Let the above-mentioned (metastable) states be labeled by k and each characterized, over some 
long time, by an average energy Ej^ and a probability distribution Pj^ with entropy Sk- They can 
then be considered as having (metastable) free energy densities fk = ^ {E^ — TSk) and from these 
one can construct a second-order statistical mechanics built on a second-order partition function 

^{y) = 

k 

which is known as a one-step replica symmetry breaking (IRSB) scheme [1-4]. The Parisi parameter 
y in (1) plays the role of an inverse temperature and is conjugate to a free energy-like quantity 
(referred to as a generalized free energy) defined as G{y) = — ^ InS. In the large-limit the sum 
in (1) can be expected to be dominated by different subsets of states for different and knowing 
the corresponding maximizing distributions gives, in analogy with standard statistical mechanics, 
information on the system in the thermodynamic limit. 

This program has been carried out with great success for dilute systems where the constraints 
are locally organized in tree-like structures. For such networks the states can be found as the fixed 
points of the iterative scheme known as Belief Propagation (BP) [5, 6], and the free energy of each 
state that enter in (1) is the corresponding Bethe approximation to the free energy. Furthermore, 
the computation of (1) can be carried out by an iterative scheme called Survey Propagation (SP), 
formally quite similar to BP [1, 7-10]. 

While there are several routes to SP theory, we will here only be concerned with a generalization 
of one presented in [1, 2] where the three steps are (i) nn efficient computation of fk using the 
Bethe approximation, (ii) an approximation of (1) by a Bethe approximation on the second order, 
and (Hi) a reduction of this approximation to SP, which can also be efficiently computed. In spin 
glass language an analysis based on BP is referred to as the Replica Symmetric (RS) level, while 
an analysis based on SP is referred to a One-Step Replica Symmetry breaking (IRSB) level. We 
will use the term IRSB to generally underline effects that follow from a sum over states as in (1) as 
opposed to considering only one state. As our focus here will be on systems in finite dimension and 
an analysis built on the Kikuchi approximation, we will also use the terms “Kikuchi approximation 
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on second level” and “second-level GBP” when discussing steps conceptually corresponding to 
(ii) above, and “Generalized Survey Propagation” (GSP) for (Hi). We note that for the Kikuchi 
approximation and the analogy of Belief propagation (step (i) above) the term Generalized Belief 
Propagation (GBP) is well established [5, 11]. 

The rationale for considering a generalization of SP of this type which we call GSP is the simple 
fact that systems in finite dimension are not arranged in tree-like structures. The above sketched 
approach is therefore, for a physical system, only valid as a mean-field theory and is typically also 
presented as such. There exists a considerable literature as to whether these approaches apply to 
finite-dimensional systems cf. [12-15] - which we will not enter except to point out that the question 
of barriers, and their heights, is one of geometry and hence strongly dependent on dimensionality. 
Indeed, even for infinite-dimensional systems much less is known about the distribution of barrier 
heights than about the distributions of free energy minima, and (1) may therefore, as pertaining 
to dynamically separate states, even in idealized cases be somewhat of an ansatz. 

The Kikuchi (or cluster) expansion was introduced to improve upon the mean-field estimates 
of thermodynamic quantities [16-18]. Algorithmically it can be turned into Generalized Belief 
Propagation (GBP) [11, 19, 20] which, though considerably more complicated than BP, can be used 
to estimate marginal probabilities on graphs with short loops and has applications to inference in 
lattice systems appearing in image processing problems [6]. The question then arises if the local 
minima of Kikuchi free energy, computed as fixed points of GBP, can be turned into a second-level 
statistical mechanics as in (1), and if that can be efficiently computed in analogy to SP. If that 
would be the case we could arrive at better systematic approximations to thermodynamics of finite¬ 
dimensional random systems and, perhaps conceptually more important, give a different kind of 
argument in favour of the spin glass approach in finite-dimensional system. This general issue has 
been already investigated in the recent literature for both the single instance and averaged case 
[21, 22] by using a different approach based on replicas which leads to a different class of equations. 
The differences between our and this approach will be discussed in Section V A. 

In this paper we attempt to address the problem by directly writing a second-order partition 
function analogous to (1) for the Edwards-Anderson spin glass model in two dimensions, but using 
instead of Bethe approximation a Kikuchi expansion based on regions containing one, two or four 
spins (“vertices”, “rods” and “plaquettes”). This leads to a quite complex statistical model on 
second level, where the variables are GBP terms (“GBP messages”) obeying hard-core constraints 
(“GBP fixed point equations”) and weighted by terms e where the fk are the Kikuchi free 

energies computed from the fixed points of GBP. We show how to perform a Kikuchi expansion for 
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this second-level model using regions isomorphic to the regions on the first level model, and hence 
also interpretable as (second-level) “vertices”, “rods” and “plaquettes”. In contrast to first level 
the amount of variables in each second-level region is however large, as will be described in some 
detail below. We also point out, as far as we know for the first time, that a Kikuchi expansion can 
be performed in many ways for such a second-level model, our choice is only one of the simplest. 
We are thus able to carry through the second step in the approach described above arriving at a 
definite - though complicated - set of equations which can be interpreted as IRSB GBP equations 
which are not the same class of those obtained in [21] by the replica Cluster Variation Method 
(CVM), see discussion in Sec V A. 

We then follow the same path which leads to SP, i.e assume the same ansatz, and discuss how the 
second-level GBP equations which we obtain here also admit a simpler class of solutions. These new 
equations can be interpreted as a generalized form of the Survey Propagation equations, in short 
a form of Generalized Survey propagation (GSP). We believe that this derivation is of interest for 
treating finite-dimensional systems in spin glasses as well as for computer science and satisfiability 
related problems. Although theoretically consistent, these equations however appear hard to solve 
computationally due to their large dimensionality and a product of different distributions as already 
pointed out in [21]. The purpose of the current work is thus to show an alternative approach to a 
generalized SP theory based on a new statistical model, in the same spirit as done in [1, 2] for the 
Survey Propagation approach. 

The paper is structured as follows. In Section II we recall the Edwards-Anderson model and in 
Section III we describe a Kikuchi approximation for this model based on regions “vertices”, “rods” 
and “plaquettes”, leading to a Generalized Belief Propagation scheme. This presentation follows 
earlier contributions by two of us [23-25] to which we refer for some of the details. In Section IV 
we introduce and discuss a second-level GBP scheme and we present the IRSB GBP equations 
at the plaquette region-graph level of the Kikuchi approximation. The differences between our 
approach and the the replica cluster variational approach of [21] are discussed in this section. In 
Section V, proceeding in analogy to the path which leads to the Survey Propagation algorithm, 
we show that this scheme does simplify similarly to the SP case to a class of generalized Survey 
Propagation equations. In Section VI we sum up and discuss our results. Four appendices integrate 
the main text and in the last of them we discuss, to our knowledge for the first time, meaning and 
computation of determinant factors which appear both in the SP [1, 2] and generalized SP theory, 
constructed by using a second-level region graph. 


5 


II. THE EDWARDS-ANDERSON MODEL 

The 2D Edwards-Anderson (EA) model [26] is defined on a finite dimensional square lattice by 
the Hamiltonian H = — J2{ij) where the first sum is over neighbouring dihcotomic 

spin variables = ±1, hi is a local external field and the Jij are quenched random variables. Using 
a factor graph representation with N variable nodes {i = 1,2,..., A) representing the spins and 
M factor nodes (a = 1,2,..., M) representing the interactions between the spins, the Hamiltonian 
can alternatively be written as: 

M N 

H{a) = Y, Eai^a) + Y (2) 

a i 

where a = (cri, (72,..., (Jw) denotes a generic spin configuration, and by we mean {<Ji\i G 9a}, 
the set of variables which are involved in interaction a. In the case of a two dimensional lattice 
this is simply = {(j^,(jj}, but the more general notation will be convenient later. In the same 
representation the partition function can be written as: 

N M 

EiP)=Y ^ E n n (3) 

a a i=l a=l 

where /3 = l/ksT is an inverse temperature and the terms 

^ M^da) = (4) 

are called “potential functions” in BP terminology. That interaction is in the more general scheme 
denoted (a) hence for later convenience we include that label also for the interaction coefficient 
also \ The equilibrium free energy is related to the partition function as 

F(/3)^-llnZ(/3). (5) 

The EA model has been extensively studied in the literature with the spin coupling constants 
Jij following the ± J bimodal distribution or the continuous Gaussian distribution with zero mean 
and variance J^. If all the external magnetic fields hi — 0, this model is in the spin glass phase 
when the inverse temperature /3 exceeds certain critical value /3c. The value of (3c is finite for 
systems in D > 3 dimensions, while /3c = oo for D = 2. The spin glass transition therefore occurs 
at zero temperature for two-dimensional systems [27-31]. 


III. REGION GRAPH REPRESENTATION AND GENERALIZED BELIEF 

PROPAGATION EQUATIONS 
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In this section we introduce a region graph description of the 2-diniensional lattice and use the 
Cluster Variation Method (CVM) as presented by Kikuchi [16-18] to compute an approximation to 
the free energy and derive generalized belief propagation equations as presented in [20, 24, 25]. This 
method was invented to make corrections to the Bethe free energy and therefore, algorithmically, 
to the BP method for loopy graphs. Alternative approaches have been carried out using loop 
corrections, both for binary and non-binary variables, in [32-34] and more recently in [35]. 

A region-graph description of a lattice model defines a set R of regions that include some chosen 
basic clusters of nodes, their intersections, the intersection of their intersections, and so on. The 
basic idea underlying the CVM is to approximate the free energy as a sum of the free energies 
of these basic clusters of nodes, minus the free energy of over-counted cluster intersections, minus 
the free energy of the over-counted intersections of intersections, and so on [11]. Following the 
description in [ 20 ], we define a region average energy as Ua{Pa) — where 

Ea{cra) is the energy term of the region a similar to those appearing in equations ( 2 ), and a region 
entropy Sa{Pa) = Pai^a) Pai^a) ^ which = {(Ji\i G a} denotes a microscopic 

configuration of the same region. The region probability P^ is a variational parameter and has to 
be determined from minimization condition. Let us observe that, in cases where P^^ is the exact 
probability distribution of the region cr, the average energy correspond to the exact value whereas, 
differently, the region entropy remains an approximation [11]. The Kikuchi free energy functional 
is then introduced as the sum of all the region contributions: 




Ea{aa) + (3 MogPa(a„) 


( 6 ) 


Above Ea{a^) is the energy term of the region cr, in the EA model, for instance, Ea{a^) = 
^iea + ^aea (®) region graph coefficients are counting number assigned 

to each region to ensure that each term only contributes once [25] and constructed recursively by: 


^7 — 1 ^ ^ 5 C^) 

{a: q ;> 7 } 

where with cr > 7 we indicate that a is an ancestor of 7 , i.e. the regions 7 is contained in the region 
a. The index a in ( 6 ) can in principle run over all the regions in the region graph although keeping 
all of them would be cumbersome. A Kikuchi approximation of the free energy at the i?-level then 
fixes a set R of clusters made of maximal clusters and all their sub-clusters, and truncates the 
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expansion of the free energy (6) retaining only terms corresponding to clusters in R. The CVM 
aims to the minimization of the above free energy (6) under the constraints that the marginals 
Pa are consistent. The saddle point equations derived from this minimization are the so called 
Generalized Belief Propagation equations. A detailed derivation of them, following this standard 
approach, is provided in Appendix A. 

An alternative formulation of the Kikuchi approximation and a derivation of GBP equations 
can be obtained formulating a region-graph description in terms of factor graphs and messages, 
i.e. normalized probability distributions, between neighbouring regions. In what comes next we 
follow such a formulation as described in [25] in order to obtain consistency relations among regions 
which will be useful in the derivation of the IRSB Generalized Belief Propagation equations (see 
Sec. IV). Within this description, generally a region fi can be a parent of another region u if the set 
u is contained in the set /i, and when this is the case we indicate the relation as /i ^ z/. Hereafter 
we consider the squares or “plaquettes” to be the larger cluster R and therefore we deal with three 
types of clusters or regions: plaquettes, rods and vertices (see Fig. 1), although the description 
presented next is very general and not restricted to such maximal clusters. Each square contains 
four vertices and four interactions and is a parent of four rod regions; each rod region contains 
two vertices and one interaction and is a parent of two vertices; while each vertex region contains 
only one vertex and has no children. In Fig. 1, left panel, the parent-to-child relations fi ^ v 
are represented by black arrows for the regions highlighted in green, namely plaquette, rods and 
vertices. We recursively define an ancestor of a region to be a parent or the parent of an ancestor: 
a vertex thus has four parents (four rods) and four other ancestors (four plaquettes). Similarly we 
recursively define a descendant of a region to be a child or the child of a descendant. A plaquette 
thus has four children (four rods) and four other descendants (four vertices). A region graph 
i?, within this description, is then a collection of all the regions and the specified parent-to-child 
relations (i.e., arrows) between these regions. 

Following a factor region graph description as in [24, 25], the partition function (3) can then be 
written as 


gi a^R SGq; 


^(/^)=n n^**^^*) n 




Ca 


( 8 ) 


where a in principle ranges over all the possible regions. As noted in [25] it is possible to introduce 
sets of messages m^^iy(a^), i.e. normalized probability distributions, between parent-child regions 
in i?, with the only constraint that ~ Ii^deed we observe that for each direct 





FIG. 1: Left panel: Region graph representation of a 2D EA model in terms of plaquettes, rods and vertices. Black 
arrows represent parent-to-child relations and are associated with messages from parents to child in the main 

text). Right panel: The squared yellow region represents the union of the border (Ra) and interior (/q,) of the a 
plaquette. The messages inside it belong to lot whereas the messages that cross the border belong to The purple 
rod region represents the same object for the rod a. Blue and red arrows represent the messages involved in the 
GBP equation from plaquette a to rod a, namely eq. (21) in the main text. The counting numbers for both figures 
are Ca = 1 for plaquettes, Ca = — 1 for rods and Ci = 1 for vertexes. 


edge /i ^ z/ the following relation holds 


X] Ca = ^ Ca - ^ Ca = 1 - 1 = 0 , (9) 

{a : a>iJ, 


where we have for each region a defined /« = {7 • 7 ^ to be the set formed by the region a 
and all its descendants, and the “boundary” of a, i.e. to be the set of regions not belonging 
to la but parental to at least one region in [25] (see Fig 1, right panel). Therefore the partition 
function ( 8 ) can be rewritten as: 


gi a^R SGo 




n 


-| Ca 


m 






a^a 




( 10 ) 


indeed due to relation (9) each message appears in (10) is net total zero times. A Kikuchi ap¬ 
proximation of this partition function corresponds to take into account only some chosen set of 
maximal clusters R in (10), their intersections, the intersection of their intersections, and so on. 
The Kikuchi approximation of the above partition function then reads as [24] 


za'(/s)= n 


n 


Ccx 


m 


/i—)-z/ 




aeR ^ ^Q, i^a 


aGa 




( 11 ) 


where, differently from ( 10 ), here a ranges over all regions up to a maximal cluster i?, for instance 
restricted to plaquettes, rods and vertices for the case discussed here. The corresponding Kikuchi 
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approximation of the free energy in terms of messages reads as: 


Fk{^) = -/3- 


■^ 5 ] Co 

cx^R 


log 




n 


m 






iGa 


aGct 


{/i— yix : fi^Bcxi F^Ioi\ 


( 12 ) 


Analogously to the standard derivation of the CVM, we then require this free energy to be sta¬ 
tionary respect to a chosen set of probability functions namely: 


SFk 


= 0 , 


V (/r —y u'j G R . 


(13) 


As noted in [24, 25], this equation is satisfied if the consistency condition between parent-child 
regions of two marginal probability distributions is satisfied, namely 


> ( 14 ) 

where is a Boltzmann factor 

fl (15) 

^ zGq: aGa 

called belief of the region a in the message-passing language and is a normalization factor 
associated to the same region. Equation (14) ensures that the marginal probability distribution 
and of each parent-to-child pair come from the same joint probability distribution. 

The constraints on the marginals, together with (15), lead to the generalized belief-propagation 
equation on each directed edge /i ^ z/ of the region graph R 


'fpbi^b) n (16) 

befiXiy 


a ^7 : 

t a G-B iz n, 7 G/iz} 


{r]^T : 

r]eBf^,reI^\Iu} 


where C is a normalization constant determined by — 1- 


A. Plaquette-rod-vertex region graph description 

As a concrete example and as a reference for the following sections, we explicitly give the Kikuchi 
partition function (free energy) and the corresponding generalized belief propagation equations for 
a region graph description of the 2D Edward-Anderson model. Letting now Greek letter a stand 
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for plaquettes, a for rods and i for vertices and introducing auxiliary functions 


^ n n ^ai^da) n (17) 

^Q, i^CX CL^CX — yi/ ^ 

Za = H mij,^u{g_y), (18) 

—a i^CL ^jj,—yu 

Zi = ^i^i{(Ti) JJ rtin^iiai), (19) 

{)Li—>-z: 

the Kikuchi partition function (11) can be written compactly as 


zk== n n n (^o) 

a^R CL^Oi i£a 

where Fk refers to the Kikuchi free energy (12). As messages go from parents to children, and as 
in the chosen region graph we have only parents (plaquettes), children (rods) and grand-children 
(vertices), we have only two instances of the general equation (16). With reference to Fig. 1, right 
panel, for the labeling, the first is plaquettes-to-rods and reads 


)'^ 6 —(^j) 


1 


F i’l{<^l)i’k{(^k)'il’b{<yhCFi)i’d{(^h 0'fc)V’c(o-fc, (Tj) 


X Trip^i){o'i^ (J/)777/(^^_)./((J/)777/^2—)■/(^ 0 ^ 17 —)-d(^0 ^k) 




( 21 ) 


where is a normalization factor. The messages which appear on the LHS of (21) are those 

depicted with red arrows in Fig 1 (right panel) whereas those on the RHS are depicted as blue 
arrows. Equation (21) can be written compactly, in a form we will use later, as 

R^a^aiOLa) ~ ^►a ({^ 77 —)-T}[?7GBa,TG/a\/a] ’ {^/5^7}[/5e(Ban/a)\a,7G/a\a]) 

The second instance is the rods-to-vertices equation and reads 

RRa^i ~ ^ ^ 1 ^j^R^a^a 5 ) RR^^a (^z 5 ^j^R^c^j j^R^d^^j j^RRdQ^j {^j ) 

(23) 

where Za^i is a normalization factor. Referring to Fig. 2 (right panel), the messages on the RHS 
of (23) are those depicted in black whereas the message on the LHS is depicted in white. Similarly 
to (21), equation (23) can also be written in a compact form as 


RRa^i{^i) — ^a^i{{RR'q^T}[r]eBa,TeIa\Ii\) 


( 24 ) 
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The GBP equations (21) and (23) have a somewhat abstract flavor. In practice they should 
be considered as iterative equations for the real parameters describing the various probability 
distributions. For completeness we give such a more detailed description in Appendix B below. 
The region graph shown in Fig. 1 is redundant in the sense that there are two directed paths from a 
plaquette region a to each of its four vertex child regions [24]. Because of this redundancy the LHS 
of the GBP equation (21) is a product of three messages, which leads to practical complications 
in updating the plaquette-to-rod message rria^aio'i^crj). In general we regard a region graph 
as a non-redundant region graph if there is at most one directed path from any region to any 
another region, otherwise the region graph is regarded as redundant [24]. In the case of a non- 
redundant region graph the GBP equation can be much simplified and the LHS of each GBP 
equation contains only one message (see [24] for detailed discussions). Although redundant region 
graphs bring in computational complications, the main reason to prefer redundant region graphs 
over non-redundant ones is that, in a redundant region graph, more consistency constraints are 
enforced on the parent-to-child messages and consequently the results are more accurate. 


B. Gauge invariance of the GBP equations 

When the GBP equations are written to be iterated, for convenience, the messages are 
parametrized in terms of fields by using an exponential representation. In principle the mes¬ 
sages can be left not-normalized therefore the following parametrization does not take into account 
their normalization which, when and if needed, can however be enforced at any time. Messages 
ma^i{cri) are written as where Ua^i is a real number known as the cavity bias on spin 

i from interaction a. Similarly, messages rria^aio-i^aj) are written as 

where the new quantity Ua^a parametrizes cooperative interactions. The GBP equations (21) and 
(23) are then to be understood as relations between parameters of the types and Ua^a- 

In Appendix B a derivation and the explicit expression for the GBP equations in terms of fields is 
reported. Here we just show their functional dependence which is the main thing for what follows. 
The link-to-vertex equation in term of fields reads as [36] 




7 («) 


(j) 


,U) 


(see Appendix B for the explicit formula). In Figure 2, right panel, the message Ua^i on the LHS 
of (25) is illustrated as a white arrow whereas all the messages which appear on the RHS are 
illustrated as black arrows. The equations for the fields involved in the plaquette-to-link equations. 
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using a similar notation as in [36], are given by 


Ua^a — o:—^a{UiU) — log 










Ub^i + log 


K(1,1)K(1,-1) 


= Qi^}^a0,u) = + Jp l^S 


i^(-l,l)K(-l,-l). 
■ K(1,1)K(-1,1) 
.i^(l,-l)K(-l,-l) 


(26) 

(27) 

(28) 


where K{ai^aj) is defined in the Appendix B and only depends on the messages in B{a)^ which 
we here call “external” field-messages, i.e. for the a ^ a equations only those illustrated as blue 
arrows entering the yellow square region in Figure 2, left panel. Therefore from (26) we observe 
that the field-messages of the kind Ua^a do not depend on any messages in I (a) that we call 
“internal” message, whereas from (27) and (28) we note that the dependence on internal messages 
appears linearly only through the messages of the kind and Uc^j respectively. 

In [36] the authors point out that parent-to-child GBP algorithms, like the one we use here, 
posses a gauge invariance on the field-message values. In fact, GBP equations for such algorithms 
admit a freedom in the choice of the fields that has no effect on the fixed point solutions. Therefore, 
following [36], every set of values of the fields which satisfies a fixed point can be changed by an 
arbitrary constant 6 as 


. X (d . (d X 


(29) 


and the resulting set of values is still a solution of the GBP equations. This gauge invariance can 
be fixed in several ways, one of the simplest is to set to zero one of the four u-&e\d in the equation 
(29). This gauge fixing method will be used in the following sections when building a second-level 
statistical model based on the GBP fixed point solutions. 


IV. ONE-STEP REPLICA SYMMETRY BREAKING GBP EQUATIONS 

We here take up the approach discussed in the Introduction and consider a second-order sta¬ 
tistical model built on a second level (IRSB) partition function (1). In the picture we want to 
consider here, the Gibbs measure is, in principle, not anymore a pure state but rather decomposes 
into a convex linear combination of pure states [1-4]. We assume that in each such state labeled 
by k the GBP equations (16) are satisfied and we denote with the set of their solution, 

for every /i ^ z/ G i?. This assumption is supported by the recent results in [37] where it is shown 
that metastable states found with Monte Carlo algorithm are linked to fixed points of the Cluster 
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FIG. 2: Left panel: First and second level region graph description overlapped for the 2D EA model. Messages 
integrated over on the LHS of (37) are illustrated with blue arrows whereas those on the RHS are pictured with 
black arrows. Central panel: same kind of illustration for equation (38). Right panel: pictorial representation of 
GBP rod-to-vertex equation (23). The message on the LHS is pictured with a white arrow whereas black arrows 
illustrate the messages on the RHS. 


Variational Method. A Kikuchi approximation of the generalized free energy (1) is then given by 
replacing the exact free energy of every state by the Kikuchi free energy computed at the same 
state, i.e. NFKim^J^Xu} in (1). The resulting second-order partition function is defined as a 
sum over fixed points of GBP weighted by their respective Kikuchi free energy: 

E{y) = ~ Y , ( 30 ) 

k keE 

where E denotes the set of GBP fixed points and with we define the Kikuchi approximation 
of the replicated or second order partition function. By standard folklore we expect either GBP 
to have only one fixed point, in which case the sum and the additional parameter y in (30) gives 
no new information, or to have many fixed points, in which case their relative contributions to the 
sum are controlled by y. The messages are considered variables in a statistical model, and 

the restrictions that the messages are fixed points of GBP are interpreted as hard-core constraints 

= E H (31) 

keE ^ 

where on each pair of connected regions (/i ^ z/), plaquette to link and link to vertex, we have 
a message and the delta functions enforce that these variables correspond to a given fixed 

point, labeled by (/c), of the GBP equations. 

Actually we cannot however sum over an enumeration of the fixed points of GBP, that would 
not be any simplification of the problem. Instead we must include the hard-core constraints inside 
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the integration as 


^^(y) = J e 5[. 


^ Lt— ^►i/(ZZ?l)] 


(32) 




where m indicates all the dependencies of the function T from the messages involved in the GBP 
equations. By postulating (32) we have ignored Jacobians from integration of the delta functions. 
If we insist that S(^) in (30) is only a sum over fixed points, with no pre-factors, we should more 
properly have 


SA'(y) = J Vm 




-^yFK{m^^jy} 


det 


d{m^ 








-] I P (33) 


where the determinant is of a large matrix - coupling the first-level variables (GBP messages) as 
they are connected by the hard-core constraints (GBP update equations) - computed at the fixed 
point of the GBP equations. This value is independent on the Parisi parameter y and therefore 
contributes only to the entropic part of re-weighting term in equation (33). For 

tractability we will from here neglect this term, to discuss it again in Section VI and Appendix 
D. We just mention that a similar determinant appears also for a tree-like topology and in that 
case it is similarly neglected as discussed in [1, 2]. Let us also observe that the above integrals 
in (32) and (33) converge only if the gauge invariance of the GBP equation is fixed (see Section 
IIIB), otherwise a volume element of the parametrization invariance appears. We assume here that 
this is the case and we specify in more details how to fix the gauge invariance at the second-level 
statistical model in Section IV C. Using (20) and (32) we can then write 

= ^ = f P ZV P Z-v P [ P - Ff,^u{rn)\ (34) 

k^E ol^R cl^R i^R (^jx — 

where we recall that Zq,, and Z^ are functions of the messages as given in (17), (18) and (19). 
We will further show below that each 5-function in (34) can be assigned to one or more regions on 
a higher-level graph. We therefore interpret equation (34) as the partition function of a new model 
where the messages represent the new variables, and the Z’s together with an appropriate set of 
5-functions are the analogues on the second level of GBP potential functions on the first level. We 
note that these second-level potential functions contain both soft constraints in the Z’s and hard 
constraints in the 5-functions. 


A. Higher-level region graph and second-level GBP 


In the previous section we introduced a second-level graphical model by introducing the new par¬ 
tition function (34). The next step towards IRSB GBP equations is to observe that the weighting 
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terms = exp {—f3yFK{m^f^Xu})/'^K induce a distribution of the messages and that, furthermore, 
this distribution can be represented as a graphical model. In this new second-level region-graph 
model the new variables are messages and the factor nodes are new potential functions or con¬ 
straints. Each factor node is connected to all the variable nodes on which it depends i.e. for 
a potential functions to all the arguments of respectively Za^ Za and and for a constraint 
6[Uij,^jy — or 6[uij,^jy — both to or and to all the arguments of 

This auxiliary model is a graph expansion of the original model, as discussed for the case 
of BP in [1, 2]. 

The second step is to define new regions in the auxiliary graph and assign the second-level 
potential functions and constraints to these regions. How to do so is not uniquely defined, no 
more than in the standard CVM. We here choose a region graph for the auxiliary second-level 
graphical model which is isomorphic to the region graph for the first-level graphical model. This 
means that plaquettes, rods and vertices on the first level will be in one-to-one correspondence with 
regions on the second level which we call by the same names. To a plaquette a on the first-level 
graph corresponds a second-level region denoted by a which contains (i) all messages going to 
descendants of a from the outside or from the inside i.e. [jia] (H) the delta functions enforcing 
that the messages in 1^ satisfy GBP; (Hi) the potential function Z^. Similarly, to a rod a on 
the first-level graph corresponds a second-level region denoted by a which contains all messages 
in Ba[JIa^ the two delta functions enforcing that the messages in la satisfy GBP, and Za • To a 
vertex i corresponds finally i which contains the four messages in and Zf. The procedure is 
illustrated in Fig 3. 

The third step is to carry out CVM on (34) with the regions defined in Fig. 3 and define 
consistency conditions for marginals between parent-to-child regions similarly to those in (14) for 
the first-level region graph. The second-level CVM is built on messages in the second-level region 
graph, which are functions of the messages m or, rather, of the fields used to parametrize the 
messages in the first-level region graph and which we here denote as Q{U^u) (probabilities of 
probabilities) illustrated by black arrows in Fig 3, right panel. Every one of these (second-level) 
messages goes from a parent to a child region and depends on all the (first-level) messages, i.e. 
message-fields, in the child region. When there is a direct plaquette-to-rod link d ^ a on the 
second-level region graph, the Qa^a rnessage depends on all the fields in the region a, that is all 
the fields in Ba U la in the original graph and so depends on 14 (first-level) field-messages. When 
there is a direct rod-to-vertex link a ^ i the message depends on all the fields in the region 

i, corresponding to the region Bi in the original graph and so includes 4 fields (see Fig 3 for an 
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FIG. 3: Left panel: Region graph representation of a 2D EA model in terms of plaquettes, rods and vertices. The 
border and interior of the plaquette region a is pictured in yellow and becomes the region d in the auxiliary model 
(yellow plaquette in the right panel). The border and interior of the rod region a is pictured in purple and becomes 
the new rod region d (right panel) whereas the border of the vertex region i, which is displayed in red, becomes the 
new vertex region i in the auxiliary model. Right panel: the auxiliary graph in terms of new regions. Numbers inside 
the regions are a memo of the number of U,u field-messages contained in each region. The arrows represent the new 
messages in the auxiliary model, indicated as Q{U,u) in the text. 


illustration). 

The CVM and GBP construction at the first level introduce two types of m first-level messages, 
from plaquette-to-rod and from rod-to-vertex, which can be parametrized using tz-fields as shown 
in IIIB. Therefore on the second-level region, by a one-to-one correspondence with the first-level 
graph, there also exist two different kinds of Q{U^u) messages. More explicitly, we represent these 
second-level messages in the auxiliary graph using a different notation for each one of them: 


n. . 7 ( 8 ) ^ 

from plaquettes to rods. 

(35) 

Qf^vi'^rXv) 

from rods to vertices. 

(36) 


where superscript numbers refers to how many messages of the kind jn ^ u are contained in the 
argument of Q. That is, the notation Up%r means I field-messages of the kind plaquette-to-rod, 
means I field-messages of the kind plaquette-to-rod of the vertex type, whereas ulXv means 
I messages of the kind rod-to-vertex, according to notation introduced in Section IIIB. In the 
following, for the sake of clarity, we omit the labels and the numbers of the fields u when they are 
arguments of the functions Q and g, i.e. we simply write Qp^f{U^u) and qf^v{u). 

We can now look at the second-level region graph as a new auxiliary region graph on an higher 
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level, which contains new messages (probabilities of probabilities), new potential functions and 
hard-core constraints. As for the first level-region graph (see eq. (14)), the new marginal proba¬ 
bilities, or beliefs, defined on the second-level region graph, which we here indicate as Wa and 
W- for new plaquette, rod and vertex respectively, must satisfy probability consistency equation as 





for plaquette a and rod a, (37) 
for rod a and vertex i. (38) 


Above the notation a\a means that the integral is taken over all the messages belonging to a except 
those which are common with a (see Fig. 2, left panel) (and similarly for a\i, see Fig. 2, central 
panel). Analogously to the marginals (15) in the first-level region graph, the second-level beliefs 
are defined through the new messages Q and g, new potential functions Z and hard-constraints 
included in each second-level region. Since equations (37) and (38) are the core of our approach to 
second-level GBP we will write them down explicitly in the following two subsections. 


B. Consistency equation for rods and vertices 

In analogy with the consistency equations (14), we here write explicitly the consistency equations 
for the second-level region graph illustrated in Fig. 3. As mentioned, we interpret the second-level 
graph as a new auxiliary graph having new potential functions. These are given by the partition 
functions Z re-weighted by the Parisi parameter new messages between parent-to-child regions 
given by the probabilities of probabilities Q and q and, in addition to the original region graph, 
contains new constraints which enforce the new variables U and u of the second-level graph to 
satisfy the GBP conditions on the first-level region graph. 

The new marginals can then be deduced by analogy with the first-level marginals. The Q and 
q messages involved in the marginal of a region are all those from parent-to-child region jl ^ i) 
where jl belongs to the border and z> belongs to the interior of the child region. The potential 
function for each second-level region must count for all the energetic interactions of that region 
and therefore it is given by the partition function of the same region which contains, indeed, all the 
energetic terms. Finally the hard-core constraints should enforce all the GBP conditions for the 
messages internal to the region and therefore they have to be all the delta functions which belong 
to the interior of the region considered. 

With this procedure as a tool, using a compact notation, the local consistency equation (38) 
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can be written as follows: 

I r ^ ^ ( 2 ) ^ 1 

— / dUdu Zl 0, u) JJ Qix^i>0 , u) JJ qjx^oiu) = (u) JJ qi^-iu) (39) 

Jd\i 

where and are normalization factors and the superscript on the products indicate how many 
Q OT q products we have on each side. The delta functions in the equation above enforce the GBP 
equations (25) for rods-to-vertex messages and are interpreted as hard-core constraints; for short 
we use the notation ;&)], where the function is defined in (25) or 

explicitly in (B5). The messages constrained by these two deltas are pictorially represented as white 
arrows in the purple rod region of Figure 3, left panel. The Z’s are potential functions referred 
to the region considered and the Parisi parameter y plays the role of an inverse temperature. The 
different kind of Q’s on the LHS are all those from the parent-to-child region jl ^ u with jl G B{a) 
and j) ^ I (a) and the products are on these same variables. Pictorially, they are represented by all 
the arrows crossing the perimeter of the orange rod region of Figure 3, right panel. Analogously, all 
the Q’s and the products on the RHS are all those from ji ^ i where jl ^ B{i) therefore, pictorially, 
the four black arrows pointing towards the red region i in the same figure. 

Similarly to what pointed out for equations (32) and (33), the introduction of delta functions 
with functional dependence on the GBP equations above would, in principle, involve a determinant 
on the LHS of (39). This determinant is of the type |det(l — A>C)| where A>C is the matrix 
containing the derivatives of the GBP rod-to-vertex function C{U^u)^ respect to all the fields U 
and u belonging to the rod region a, computed at the fixed point. As shown in Appendix D, it 
turns out that this determinant is equal to one and therefore brings no correction to the above 
equation. 

Writing more explicitly (39) for the rod a and the vertex i on the expanded graph, with reference 
to Fig. 3 for labelling, we have 

A [ dUdu Z0U,u) Qa^a0,u)Q^^^0,u) q~^^0a) q^^^iiu) q^.^ii'd) 

^d J d\i - 

1 

X q^^jid) q^^^jid) q^^^-id) = («) q^.^-id) q^.^-id) (40) 

- 

where the common terms on the left and right-hand-side have been underlined by a dashed line. 
Let us observe that the integration does not involve these underlined terms. Indeed these terms 
only depend on the u field-messages which belong to the region i whereas the integration is over 
the u in the set a\i. Referring to Figure 2, central panel, where the u are illustrated by arrows, the 
integration only involves the blue u^s in the purple region a and does not include the black fields 
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shared with the red region i. Therefore since the underlined g’s never depend on the variable of 
integration they can be canceled on both sides of the equation. The result reads 

_ dUdu u) (^1) 

J d\i 

where we used the relation (C4), i.e. Za = Za^i J Zi 6a^i expressed in terms of field-messages, and 
we omitted the field dependencies of the Q and q second-level messages for brevity. We observe 
that the field Ua^j is integrated over on RHS of (41) and, in addition, Za^i does not depend on 
this message (see (C4) for details). We then integrate over this field and make use of the delta 
function 6a^j^ we get 

Qa^iiu) [ dUdu Z^^i{U,u) Qa^a ^de^j ' (^2) 

^d Jd\i 

With the tilde notation above we indicated functions Q and q with the value of Ua^j in their 
argument replaced by their GBP updates (25) i.e. by Equation (42) corresponds to 

the IRSB rod-to-vertex Generalized Belief Propagation equation for a 2D lattice model as the EA 
model and represent the first result of this paper. We recall that the Q and q functions above, as 
their tilde version, are joint probability distributions of several messages therefore equation (42), 
although analytically consistent, it is very hard, perhaps impossible, to iterate numerically. In 
Section V we discuss how to take an SP-like ansatz on the Q and q functions to simplify the above 
equation. 


C. Consistency equation for plaquettes and rods 

Similarly to the previous section and with an analogous notation, we here want to write more 
explicitly the consistency equations between plaquettes and rods on the second-level region graph. 
Equation (37) can be written as 



1 ^ (2) ^ (6) 

= :^Zl{U,u)Sa^iSa^jY{Qp^r{U,u)Y{qr^v{u) (43) 

^d 

where and are normalization factors. The second-level messages which appear on the LHS 
are all those from the parent-to-child region jl ^ iz with jl G B{a) and z> G I {a) and the products 
are over these variables. Pictorially they are represented in Figure 3, right panel, by all the arrows 
going through the perimeter of the square green region. The Q’s and g’s on the RHS are those 
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going from jl ^ 0 with fi G B{a) and i> ^ I{d) and are illustrated, in the same aforementioned 
picture, as the arrows crossing the perimeter of the rod orange region. The product on this side of 
the equations are on these same variables. 

Delta functions in the equation above enforce GBP equations for the field-messages at both the 
plaquette-to-rod and rod-to-vertex level and, as for (39), are interpreted as hard-core constraints 
for the second-level region graph model. Their upper script refers to how many delta functions of 
the type /jl ^ v are included. All those on the LHS of (43) enforce constraints for the field-messages 
of the region I{oi) whereas those on the RHS enforce constraints for the region /(a). Note that 
since I {a) C I {a) some constraints appear on both sides. 

More explicitly, on the LHS four deltas enforce GBP plauqette-to-rod equations (26) for the 
first level field-messages Up^r — ^[Up^r — u)] and eight deltas enforce equations 

(27) and (28) for the field messages u^Xr as d^Xr = 5[uXXr — GpXriLL^ik)]- The remaining eight 
deltas enforce the GBP link-to-vertex conditions (25) as Sr^y — 6[ur^y — Cr^y{tX^ u)] and two of 
them appear also on the RHS. For clarity, referring to Figure 3, left panel, the field messages U 
and u constrained by the delta functions on the LHS of (43) are illustrated as black, red and white 
arrows in the interior of the yellow square region a. Whereas the field-messages on the RHS of 
the same equation constrained by the two delta conditions are illustrated as white arrows in the 
purple rod region d of the same figure. 

Note that, as for the rod-to-vertex equation, the introduction of the delta functions would, in 
principle, involve a determinant term on both sides. The LHS of (43) should be multiplied by 
|det(l — AJ^)| where is the matrix of all the derivatives of the GBP plaquette-to-rod and rod- 
to-vertex equations respect to all the field-messages in the plaquette. Similarly, the RHS should 
be multiplied by |det(l — A>C)| which is the same determinant, equal to one, encountered in Sec. 
IV B. It turns out that, after fixing the gauge of the GBP equations as shown by the rest of 
this section, also |det(l — AJ^)| is equal to one (see Appendix D) and therefore there exists no 
correction to the one-step replica symmetric GBP equations because of the determinant, neither 
for the plaquette-to-rod nor for the rod-to-vertex equations. 

Writing equation (43) more explicitly, with labeling referred to Figure 3 we get: 

^ / dUduZf^{U,u)Q^ 

-^aQp^b Qp^d Qx^a Qdi^lQd2^lQd3^kQd4^kQd5^jQdQ^jQdr^iQds^i 
Ja\d - - 

X ^c-^k^d-^k ^d^l 

= ^Zl{U, u) 5a^i 5a^j 


Q/3 -^aQ a^aQc^j Qd^ -^j Qdg —> j Qdj^i Qds^i Qb^i 


(44) 
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where, on both side of the equation, common probability terms have been underlined and field 
dependencies of the Q and q second-level messages are omitted. To shorten notation, terms like 
6aXa above stands for Sa^a^aKa^aXa and enforce GBP constraints for the fields Ua^a^^aKa 
and Ua^a respectively. Let us note that all the underlined probabilities of field-messages have no 
dependence on the fields which belong to the region d\d but, rather, they only depend on the 
fields fields U and u which are in the second-level region a. Using the left panel of Figure 2 as 
a reference, the underlined second level messages only depend on the field-messages illustrated as 
black arrows which cross or are internal of the purple rod region a. Therefore since the integration 
on the LHS of (44) is only over the field-messages in d\d (the blue arrows in the aforementioned 
figure), the underlined Q’s and g’s can be simplified on both sides. Using the relation among 
partition functions of different regions contained in the Appendix, i.e. (C5) here written in terms 
of field messages as Zq. = Zo^^a f Za Sa^a we can then rewrite (44) as 

Qa^aQb^iQc^j —^ / dUdu Z^^^{U ^ u) Q Q x^aQdi^lQd2^lQd3^kQd4^k 

J a\d 

^ da^i da^j dc-^j dc^k dd^k dd^l db^i (45) 


Let us note that the two deltas 6a^i[ua^i — Ca^i{LL^u)] 6a^j[ua^j — dla^j{LL^u)] only de¬ 
pend on field-messages in a, i.e. on first-level field-messages which are not integrated over in the 
above equation. Therefore, although d contains fourteen field-messages, equation (45) only holds 
information for the subset where the two messages Ua^i and Ua^j in 1(a) are determined by the 
eight messages in B(a) through the constraints Sa^i and Sa^j. Otherwise the meaning of this 
aforementioned equation is trivially 0 = 0. 

In the following we want to proceed integrating out all the deltas on the RHS of (45) which do 
not enforce constraints on those fields-messages directed to the region 1(a). Referring to Figure 2, 
left panel, we want to integrate out all the fields internal to the yellow square region 1(a) (pictured 
as blue arrows), except those directed to or internal at the purple regions 1(a) (pictured as black 
arrows). 

First of all we impose gauge fixing conditions for the GBP equations at the plaquette level as 
discussed in Sec. IIIB and in reference [36]. According to this gauge fixing procedure, at the 
first-level region graph we set to zero four of the messages Ua^r in I(r). This means that, at the 
second-level region graph, four over eight deltas 6aXr(Ua^r “ Ga^r(U^ u)) are changed to 6(Ua^r)‘ 
For each rod in the region graph there exist two of these deltas (see for example Fig 2), the choice 
of which to change accordingly to the fixing gauge conditions discussed in [36] is totally arbitrary. 
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(i) (1) (k) (j) 

we then choose to change Among these deltas, we integrate out those not 

referred to messages heading to a, therefore just 6a^c • The effect of this integration 

on the rest of the remaining terms is to set to zero the related field-messages wherever else they 
appear. 

We then integrate out three over four of the delta functions which fix the GBP conditions for 
the fields-messages Ua^r^ which enforce (26), in particular we integrate out 
Let us observe that the function u) which appears in 6a^r{Ua^r — ^a^r{U^ u)) only depends 
on the external field-messages in B{a) which, at the GBP level for the plaquette cr, are known 
values. Therefore the effect of this integration on the remaining terms is to change the value of the 
Uc^^r by the values of some external field-messages, wherever they appear. 

We continue by integrating out three over four of the remaining u^^\r field-messages from 
plaquette-to-rod of the vertex type and make use of the relative delta functions which enforce the 
GBP equations (28) for these fields. Explicitly we integrate out Let us note that 

the RHS of the equations (28) enforced by these deltas is a function of the external messages, i.e. 
messages in B{a)^ and depend linearly on one message which belong to I (a). To write it more 
explicitly, we could for instance write one of these deltas as SaXa{uaXa — {h{Uex^ Uex) — Uc^j)) where 
the label ex stands for “externals”, i.e. those fields are in B{a) and h{Uex^'Uex) = Q{U->u) -h Uc^j 
from equation (28). Therefore, the integration over these deltas has the effect of changing messages 
of the kind into a function of the external messages and of one internal message of the kind 

We observe that this effect refiects on the link-to-vertex delta function 6i)^i^6d^k^Sc^j in a 
peculiar way. Indeed after these and previous integrations, the GBP functions contained in these 
deltas become only functions of the external messages, for instance 6c^j{uc^j — Cc^j{Uex->Uex))- 
This is due to the linear dependence that these latter delta functions have on the internal message 
of the kind Uc^i and it entails simplifications (see equation (B5) for details). 

We carry on by integrating out 6i)^i^6d^k which only bring dependencies on the external mes¬ 
sages in the remaining terms. After these latter integration, we are left with the deltas for the 
fields both heading to and internal at the region /(a), i.e. 6a^j^ Sa^i^ 6c^j 

and, in addition, with Sd^i{ud^l and SQ^ki^'^c^k ^c^kij^ex') "^ex 7 ) ) • 

Therefore if we now integrate out 5d^u fhe field Ud^i will be replaced by a function of both the 
external messages and Uc^k- We carry on by integrating out also Sc^k^ 21s a consequence Uc^k will 
be replaced by a function of both the external messages and of Ua^j- Equation (45) after all these 
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integrations reads as: 

Qa^a Qb^i Qc^j / dUdu , u) Qp^jj Qx^q Qdi^l qd 2 ^l Qds^k Qd^^k 

Ja\d 

^ da^a ^c-^j da^i (46) 

where the tilde notation of the second-level messages and on the deltas means that some of their 
arguments have been replaced by their GBP updates because of the integration over all the other 
deltas listed above. Let us observe that both sides of the equation (46) depend on all the field- 
messages in the region a, i.e. B{a) [jl{a) which are pictorially represented in Figure 2, left panel, 
as all the black arrows entering and internal to the purple rod region. Equation (46) corresponds 
to the IRSB plaquette-to-rod GBP equation for the 2D EA model. Since the Q’s and g’s functions 
above are joint probability distribution of messages, similar considerations as those in the text 
below (42) apply here. 

V. A CLASS OF GENERALIZED SURVEY PROPAGATION EQUATIONS 

We start by explaining the approach to Survey Propagation (SP) described in [1]. The success 
of Belief Propagation is to a large extent due to its moving information forward. Indeed, this is 
why these algorithms are referred to as propagation. SP is a special class of solutions to the general 
second-level, IRSB, BP equations which has the same property and for which the fixed points can 
therefore be found by forward iteration. 

In the following we want to verify whether the second-level IRSB GBP equations presented in 
the previous section admit a special class of solutions of the SP-type and can therefore be written 
as a class of Generalized Survey Propagation equations. The special solutions of SP are derived by 
assuming that a second-level message qf^v depends on the one first-level message going the 
same way, i.e. on rria^i [1]. Taking the same assumption, in our case, means that all the Q^^f’s 
only depend on the underlining message rrip^r function of two spins and therefore parametrized 
by three ?i-fields, whereas all the qf^v^^ depend on the message rrif^y function of one spin and 
therefore parametrized by one ?i-field. In other words, plaquette-to-rod messages as Qa^d will be 
assumed to be function like Qc^^d{Ua^a^ and rod-to-vert ex message to be qa^i{ua^i) > 

Following the SP ansatz we assume that this is so for all the second-level messages on RHS of the 
rod-to-vertex equation (41) and we verify that the assumption is preserved on the LHS. We observe 
that, the field-message Ua^j only appears on RHS as an argument of the delta function 5a^j which 
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can be integrated out to give 




^^de^j) 

^d J d\i 


M) yU) 

X Qa^a Q/3^a ^ae^j* 


(47) 


Above we have written out the arguments of (on LHS) and Za^i (on RHS) explicitly and we 
recall that the integration turns out to be over all the messages appearing as argument of Za^i- 
Compared to (42) we have now gained that the Q and q functions appearing on RHS are the 
original ones which, by assumption, still only depend on one underlying first-level message. Let us 
now consider on what arguments actually depends q^^i- Obviously it depends on its first argument 
since Ua^i appears explicitly on RHS in the delta function 6a^i{ua^i — Ca^i{U^u)). However, it 
does not depend on its other three arguments since neither ui^^i nor Ud^^i nor Udg^i appear on 
RHS. Therefore the assumption that second-level messages only depend on the underlying first- 
level message going the same way is preserved by the iteration of (47). We observe, in addition, 
that on a tree topology the above equation reduces to the SP equation for the single instance case 
[ 1 , 8 ], 

We then consider the plaquette-to-rod equation (46) and take the same kind of SP-ansatz for 
the second-level messages on its RHS and observe that, as for equation (47), they no longer depend 
on several external messages brought into their argument by the integration of the internal delta 
functions performed in the previous section. We therefore remove the tilde notation for them and, 
after the SP-like ansatz, equation (46) reads: 

QoL^a qb^i qc^j —^ / dUdu Z^^^(U^ QQjj^dQX^aqdi^iqd2^iqd3^kqd4^k 

Ja\d 

^ dc-^j da^j (48) 


To shorten notation we here do not write explicitly all the dependencies of the partition function 
Za^a but it turns out that it depends exactly on all the U and u messages which appear as 
argument of the SP-like Q’s and g’s on the RHS (see Appendix C) and, as for (47), the integration 
is precisely on all of them. Using the left panel of Figure 2 as a reference, the integration on the 
RHS is over all the field-messages represented as blue arrows entering the yellow square region. 
Let us now look at which are the field dependencies of the RHS of (48). It depends on the fields 
appearing in the delta functions 6a^a^ da-^a, and Sc^j which are not integrated over on 

the RHS. These dependencies are encoded in a SP-like dependence of the Q and g’s on the LHS. 
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In addition, the RHS also depends on all the fields contained in the delta functions Sa^i and Sa^j 
which are also present on the LHS. To give a pictorial representation then, referring to Figure 
3, left panel, the delta functions on the RHS depends on the fields represented as red and white 
arrows. These dependencies are encoded on the LHS by the Q and the g’s and the two deltas. 
The RHS also depends on the fields represented as black arrows entering the purple region in the 
same figure. These dependencies are encoded on the LHS by the functions £(1/, u) in the two delta 
functions 5a^i{Ua^i - Ca^i{U,u)) and 6a^j{Ua^j - Ca^j{U,u)). 

Summarizing, equation (47) and (48) remain consistent after the SP-like ansatz is taken and 
therefore represent a class of generalized GBP equations for the distributions of the field messages, 
i.e. Q{U^u^u) and q{u)^ similarly as the Survey Propagation [7-10] equations are Belief Propaga¬ 
tion equations for the distribution of the field-messages, i.e. q{u). Although these equations are 
consistent, they would naturally be cumbersome to use in practice. Indeed the right-hand side 
is a convolution of many terms and, more importantly, the left-hand side is a product of several 
distributions and delta functions. Despite the delta functions appearing on the LHS could be in¬ 
tegrated on both side of the equations, the product of distributions on the LHS does not allow to 
use a population dynamic algorithm to iterate the equations. Therefore, the paramagnetic regime, 
where the equations very much simplify and the product of distribution on the LHS reduces to a 
single distribution Q{u)^ seems to be the only regime where the equations can be iterated (see [21] 
for a pioneering contribution about simulations in the paramagnetic phase of the average case). 

A. Comparison with the replica cluster variational method 

In an earlier effort Rizzo and co-authors [21] devised a replica cluster variational method (CVM) 
for studying the EA spin glass model. Here we discuss the relationship between our work and this 
replica cluster variational approach. 

Reference [21] starts applying the CVM formulation to the variational free energy of a n-times 
replicated system. Through a standard variational approach replica-GBP equations are derived. 
The main idea of the authors is then to use a replica symmetric or a more general Parisi’s hierar¬ 
chical ansatz in order to send the number of replicas to zero and so obtain the corresponding RS or 
(RSB) GBP equations. The core of [21] is dedicated to the analytical and numerical study of the 
paramagnetic and spin glass replica-symmetric phase of 2D EA model, by considering a plaquette 
approximation of the averaged free energy. In the Appendices, the authors also show the GBP 
equations for a generic A;-RSB ansatz, both at the averaged and single instance case. 
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Our method, on the other hand, starts from the assumption that each GBP fixed point corre¬ 
sponds to a macroscopic state at the IRSB level. We then build a factor graph model at the IRSB 
level in which variable nodes are functions (GBP messages at the RS level) and factor nodes are 
functional of these GBP messages. The GBP equations on this new factor graph model is our IRSB 
GBP scheme. We then focus on the single instance case and therefore do not perform averages 
over the quenched disorder. Generally speaking, both the replica CVM and our approach can be 
in principle be used to derive RSB GBP schemes for single instances as well as average cases. 

It is interesting to observe that these two approaches provide the same kind of equations for 
non-redundant region graphs or, even more simply, tree-like topologies. When the graph considered 
shows redundancy, the sets of equations provided by the two approaches are different and result 
to be the same only in the paramagnetic phase. We therefore expect, in this regime, a physical 
behaviour different to the one studied and encountered in [21]. The dissimilarities between the two 
approaches mainly come from a different derivation. We list them shortly in the following. 

In our approach we start assuming that parent-to-child second-level messages depend on all 
the i^-field contained in the child region. This means that, plaquette-to-rod Q messages depend 
on 14 field-messages (see dependencies in eq. (35)) whereas rod-to-vertex q messages depend on 
4 field-messages (see eq. (36)). After the SP ansatz though, our parametrization of the messages 
turns out to be the same as Rizzo et al (see Sec. V). 

Second, in [21] the authors point out that the replica CVM Q-messages, at the RS level and 
in the average case, are positive definite only in the paramagnetic phase - where their equations 
coincide with ours - and therefore can be interpreted as populations only in this regime. As soon 
as the temperature is lowered below the spin glass transition, they observe that these messages are 
not necessarily positive definite, therefore they should not be interpreted as probability functionals. 
In the CVM treatment, then, only the beliefs of second-level regions have a probabilistic meaning. 
This non-positive definite property indicates that the messages at the RS levels are correlated 
and redundant. In our formulation, before the SP ansatz is taken as discussed Sec. V, the IRSB 
parent-to-child Q-messages depend on all the ^/-fields in the child region, as stated above and in eqs. 
(35) and (36). This parametrization accounts for correlations among ?i-messages and we therefore 
believe that the Q’s could be considered as probability functionals. The SP ansatz taken in Section 
V corresponds to project these functionals on a subspace in order to reduce their dimensionality. 
We conjecture that the non-positive definite property of the Q’s would only appear for the average 
case. In this case all the parent-to-child Q’s are, indeed, not region dependent and there exist 
only one type of plaquette-to-rod and rod-to-vertex second-level message. These latter appear in 
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a convoluted form in the plaquette-to-rod equation and therefore the achievement of a fixed point 
requires to relax the positive-definite property of the Q’s. Such extra assumption should not be 
needed in the single instance case. 

On a technical and, more important, physical point of view, we also mention that every k- 
RSB formulation of the GBP equations should deal with the gauge fixing of these equations at 
the first-level. This issue was firstly raised in [36] by the same authors of [21] and following these 
considerations we addressed this issue in Section IIIB. The same could be done in the CVM replica 
scenario but at the time of [21] this was not yet completely understood. 

VI. DISCUSSION 

We have considered a one-step replica symmetry breaking description of the Edwards-Anderson 
model in 2D through a second-level statistical model built on the extremal points of a Kikuchi 
approximation. These extremal points can be computed as fixed points of Generalized Belief Prop¬ 
agation (GBP) in a parent-to-child message-passing scheme on a region graph with redundancy. 
We have discussed the fact that these GBP equations exhibit a gauge invariance and how that can 
be corrected for by setting some parts of the GBP messages to zero. We have then shown that a 
second-level theory can be constructed where the variables are probability distributions over GBP 
messages, and the fixed point equations are consistency equations between marginal probabilities 
of regions in the second-level region graph. We have further shown that this theory has a set of so¬ 
lutions analogous to Survey Propagation (SP) where each second-level message in the second-level 
model depends only on the corresponding first-level message in the first-level model. For this to 
be possible it is necessary to again use the gauge invariance and gauge fixing of GBP. 

Three comments impose themselves. The first concerns the resulting Generalized Survey Prop¬ 
agation (GSP) equations given in final form as equations (47) and (48). While it would in principle 
be possible to simulate them numerically, in practice that would be quite a cumbersome task due 
to their high dimensionality and the product of three messages on the left-hand side of (48). For 
high enough temperatures, within the paramagnetic phase, the above equations would simplify 
and numerical treatments become easier although still involving. A numerical investigation of this 
regime, as reported for instance in [21] for the replica symmetric case, goes beyond the purpose 
of this paper. Our contribution is therefore mainly of a conceptual nature, pointing to how a 
generalization of Survey Propagation (SP) to finite-dimensional systems can be carried out, and 
how complex such an approach appears to have to be. 
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A second comment concerns the determinant (Jacobian) discussed around equation (33). To 
our knowledge such determinants have never been discussed before in the literature concerning 
GSP. It is clear that they must always appear as long as the second-level region graph has loops, 
and it is also clear that the determinant would be a global characteristic of such a model. On a 
second-level Bethe lattice, which underlie SP and which has no loops, such determinants is equal 
to one. We believe that the analysis of such determinants is an interesting though non-trivial task 
in itself. 

Finally, given the prediction that a spin glass is only present at zero temperature in the 
Edwards-Anderson model in 2D then we should take the zero temperature limit. We note 
that in the application of IRSB to random satisfiability problems the temperature is also zero, 
corresponding to hard constraints, in the first version of SP considered together with the limit of 
y equal to zero [8, 9]. All solution clusters or zero-energy states are then weighted equally with 
no entropic terms depending on the size of each cluster. In a later development it was shown 
that for the same problems and when y is larger than zero entropic terms appear that separate 
clusters of different sizes [1]. It may be that the determinant referred to above complicates the 
picture in the case at hand, particularly for small and we therefore leave this issue to future work. 
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Appendix A: A derivation of GBP 

In this appendix we derive the GBP update equations (16) from a constrained variation of the 
Kikuchi free energy functional (6). The material is standard and included only for completeness, 
see [5]. The task is to minimize the Kikuchi free energy functional Fk in (6) i.e. 

Ea{g:^) +logPa{g_^) 


Pk = 'FcaY^ -Pa(^a) 
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where we have introduced the energy of a region as 

Eai^a) = hiCJi + Y 

i^a a^a 

The variation is of the marginal probabilities Pa{^a) under the constraints that they have to be 
consistent with each other. This means, in the situation under consideration, that if a rod region 
a is a child of plaquette region a then \a — Pa{QLa) where \ is the exclusion 

set consisting of all spins in a that are not in a. Similarly, if a vertex region i is a child of rod 
region a then \ai ^ai^a) — Pi{^i)' Introducing Lagrange multipliers ^oi\a{^U^k) nnd \a\i{^i) fo 
represent all these constraints, where the spin indexing follows Fig. 1, as well Lagrange multipliers 
qa and qi for the normalizations of Pq., Pa and we arrive at 

Pi oc 

g g Q^^'Y/iia — yi ^ct\i ^ ca ^ ^^oc’.oc — ya ^oc\a ^A.1^ 

Pq/ oc e Q 

Referring to Fig. 1 for the labeling of the regions, where e.g. vertex i has four rod parents, of which 
one is a and the one opposite is called ds^ and a rod has two plaquette parents, of which one is a 
and the other one is /3, we can introduce auxiliary normalized quantities 


rua^i oc 

(A2) 


(A3) 


In terms of the rria^i and the rua^a the marginal probabilities of the regions then take the GBP 
output equation form i.e 

Pi oc 

Pa OC e n6:6^.i\a ricc-yiVa (-^4) 

Pa OC e-l^^‘^m/^^a'mp^b'rn^^d'mx^cYlk=i'^dk^- 

where the dummy argument in rridj^^. indicates the vertex in the intersection of dk and a. Varying 
the messages in (A4) gives the GBP update equations as described in the main text. Alterna¬ 
tively one can check that the marginalization constraints expressed in the Lagrange multipliers 
themselves, which are 

g 'Ptb:b^i\a ^b\i \ ^ g (^^cx\a~^^/3\a^ 

(A5) 

^ g-/^(^c.-K)-/ 3 Ec:a^c\a V|c 

are equivalent to the GBP update equations for the messages. We observe that nothing in the 
above derivation really depends on how many variables (spins) there are in the various regions and 
what their interactions are; the derivation therefore also holds for the second-level GBP. 
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Appendix B: GBP equations for the 2D Edwards-Anderson model: from messages to fields. 


In this appendix, by parametrizing the plaquette-to-rod and rod-to-vertex messages in terms of 
cavity fields, we want to rewrite the GBP equations (21) and (23) in terms of fields. As already 
shown in the main text, a message ma^i{(Ti)^ which is a probability distribution on the spin ai 
up to a normalization, can be written as where Ua^i is the cavity field on spin i from 

interaction a. A plaquette-to-rod message rua^aio'i^o'j) is a probability distribution on two spins 
and can be written, up to a normalization, as where the new quantity 

Ua^a parametrizes two body interactions. The GBP equations (21) and (23) are then relations 
between parameters of the types Ua^i^ Ua^a and Ua^a- In addition we remind that the potential 
functions present in the GBP equations are given accordingly to the definition in the EA model 
as in (4), namely ^pi{(Ti) = and p^aioLda) — 

Rod-to-vertex equation: To write this equation explicitly we note that the RHS of (23) can be 
parametrized as a function of the spin and aj\ 


—^7, ^(1 — 


(Bl) 


where 


X. 


: = 7/(*) 


+ U 


(i) 


^3 — + ^dQ^j , 




ij — Jij ^ + Ua^a + 


(B2) 

(B3) 

(B4) 


Computing the rate ma^i{'\-)/ma^i{—^) with the parametrization given above and taking the 
logarithm on both sides of the resulting equation, we obtain the expression for the rod-to-vertex 
field [36]: 

1 , \ cosh[l3{xj + Xij)]- 


Ua^i = ^ 


(B5) 


cosh[/3(xj — Xij)]. 

Plaquette-to-rod equation: In the following we will not keep track of the normalization con¬ 
stants of the various messages. With the parametrization of messages in terms of fields given above, 
equation (21) can be written as: 


exp 


+ Uc^j)^j + Ua^a 


(i) 


(J idj 


) (B6) 
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where the function K{ai,aj 
K{ui,uj) = ^ exp 


), according to the RHS of (21), reads as: 
{{hi + + Ud2^i + 


^ki^l 

{hk + + '^dz^k + Ud^^k + (^'^) 

(jf + Up^b)<Tiai + (4^) + Up^dMak + {Jif + Ux -^C )(T/cCrj^ j • 


After some simple algebra the plaquette-to-rod fields on the LHS of (B6) are then given by 

,« _..w .. , 1 i^(i,Wi,-i) 

, 0 ) 


“aAa =^%h - ^ 


^X-^c 

C/a^a=^log 


1 


LK(-1,1)K(-1,-1). 
i^(l,l)K(-l,l) 
K(1,-1)K(-1,-1) 
i^(l,l)i^(-l,-l) 


^c^i + ^log 


Lif(l,-l)K(-l,l). 
where we used a similar notation as in [36] to facilitate understanding. 


(B8) 

(B9) 

(BIO) 


Appendix C: Useful relations relative to the the partition functions 

In this appendix we want to show some relations among the different partition functions en¬ 
countered in the main text which are useful for the presentation of the theory in Sec IV. We wish to 
show that the partition functions of the plaquette, rod and vertex regions are related among each 
other through the partition functions which appear as normalizing constant in the GBP equations 
(21) and (23). Let us write explicitly the partition functions for the region considered through the 
paper: 

^ ^i{(Xi) ^j{aj) ^k{(^k) ^l{(Xi)^a{(Xi, aj) ^b{ai, ai) ^c{(Xj, CFk) ^dicTk, (^l) 

(7i^(7j ,(7; 

X ?7l^_^a((Tj, (Tj^Tnp—yb{o'l , (Tj)?Tl^_^£;((T/j, (Jl^Tn\^Q{(Tj , (7fc) 

X rnd^^i{(Ti)md2^i{(Ti)mdz^k{(Xk)md^^k{(Xk)mdz^j{(Tj)mdQ^j{(Tj)mdj^i{(Ti)mdz^i{ai) (Cl) 
Za^ 'ipi{ai)ipj{aj)ipa{cri,aj)ma^a{(Xi,crj)m)s^a{cri,crj) 

(Ti^CFj 

X (^(Jj^TTld^^j (^(Jj^UldQ^j {^(Jj ) 

= '^'tpi{<^i)ma^i{ai)mb^i{ai)mds^i{ai)mdj^i{ai) 

CTi 


(C2) 

(C3) 
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Let us first consider the relation between the rod and vertex partition function. The rod partition 
function (C2) can be rewritten as 

E ^a^i) duia^i 

^ O'i 

['^q:—)- a 5 5 ^^5—)-j 5 >-j] 

X I i(™„, - £„,) <!»„, (04) 

where in the first equality we used the RHS of the GBP equation (23) to recognize rria^i in (C2) 
and we introduced the delta function to enforce such a GBP equation. The function Za^i is the 
constant appearing in equation (23), its and the Z^’s dependencies on the messages are written 
explicitly on the RHS for clarity. Using the expression (Cl) and (C2), a similar calculation shows 
that the plaquette partition function can be written as 

Za ~ Z(y^^(i\jTlp^i)^ Ulx^Q^ TTifi-^^j^ TTid^^j ^ j Z^ Si^TTlc^^a ^o^^a) dTTlQ^^cL 

(C5) 

where we used the the RHS of the GBP equation (21) to recognize and substitute terms equivalent 
to rua^a icL (Cl) and the delta function to enforce such a GBP equation. The function Z^^a above 
corresponds to the constant factor of equation (21) with its own dependencies written explicitly 
for clarity. 


Appendix D: Computation of determinants 

As already pointed out in the main text, a proper formulation of the second-level GBP equations 
should take into account determinant factors which act as entropic corrections in the re-weighting 
terms included in the partition functions at the second-level. 

We encountered two classes of these corrections, the first one is the determinant appearing in 
equation (33). This term corresponds to a large L x L matrix where L is the number of GBP 
messages (plaquette-to-link and link-to-vertex) appearing in the whole square lattice considered. 
Its contribution can be written as |det(l — JI)| where JJ is the Lx L matrix of all the derivatives of 
the GBP equations respect to all the plaquette-to-link and link-to-vertex field messages computed 
at the fixed point. Its explicit computation is a cumbersome task therefore, at a first level of 
modelling, we neglected this contribution. 

We can instead compute explicitly the second class of determinant corrections arising in the 
main text, which are those appearing in the consistency equations (39) and (43), used to derive 
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FIG. 4: Left and central panel: second level rod and plaquette region respectively with external field-messages 
depicted as black arrows and internal depicted either as blue or red ones. Right panel: plaquette region after some 
of the internal field-messages have been integrated out. All the red arrows in the central and right panel represent 
fields with gauge fixed (see Section IIIB and IV C). 


the GBP equations at the second-level (see lines below these equations). In the main text we claim 
that these two determinants are equal to one. Hereby, rather than computing explicitly the matrix 
of all the derivatives in the two cases and calculate it at the fixed point, we give a simple argument 
which proves our claim. 

Let us recall that determinants appear in the equations because of the integration of the delta 
functions, we here show that, these integrations can be carried out completely without entering in 
loops and, therefore, the determinant contribution is equal to one. Hereafter we refer to figure 4 for 
a pictorial representation. For the case of the equation (39), the term |det(l — A>C)| rises because 
of the presence of the two delta functions and The fields enforced by these deltas 

are represented in figure 4, left panel, by blue arrows which (according to their GBP equations) 
only depends on the external fields of the link region (depicted as black arrows). Therefore the 
integration over Ua^i and Ua^j can be carried out and the result will be just the change of the 
value of these two fields with external ones and hence the determinant contribution turns out to 
be one. 

More involved is the same proof for the term |det(l — AJ^)| appearing in equation (43). This de¬ 
terminant emerges because of the integration over all the delta functions enforcing GBP conditions 
for the fields in /(cr), depicted with (non-black) arrows in figure 4, central panel. 

We here want to stress that, to finally prove that also this term in equal to one, it is crucial to 
fix the gauge (see Section IIIB and IV C), i.e. to change some deltas from 5{ux^y — Fx^y {...)) 
to 6{ux^y). This indeed breaks the loop between the GBP equations inside the plaquette region, 
as it will be clear in the following. Fields which have been changed accordingly to the gauge fixing 
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are depicted as red arrows in the figure above for clearness. 

The evidence is based on a similar procedure encountered in Section IV C where we integrate 
some delta functions to simplify the equation therein. We start integrating out all the fields 
Ua^a^ Ua^c^ which are the central arrows from the plaquette-to-link in Fig. 4, central 

panel, noting that, according to their GBP equations, these fields depend only on other external 
fields (black arrows). We then integrate out all the (right oriented)-fields of the type UaKa (namely 

) and observe that, as mentioned in the main text, these integrations 
(see equation (B9)) have the final effect of changing the dependence of the (counter-clockwise 
oriented) fields like Ua^i on only external fields (see equation (B5)). We then can carry out the 
integration over these latter fields, namely Ua^i^ Once this is done, the remaining 

fields depends on the external other fields (see equation (B8) 

considering that messages of the type ui)^i have been integrated out and carry only a dependence 
on the external fields). 

We are then left with a picture illustrated in Figure 4, right panel, where there remain only 
four internal fields to be integrated out. As we can see, in principle, these fields are in loop chain 
dependence according to their GBP equations. Indeed, using ^ as a symbol of dependence, we 
have that ui^^i Ud^i Uc^k and so on. It is therefore here that, the gauge 

fixing condition becomes vital to achieve the result. Indeed, after the gauge is fixed, the fields 
depicted as red arrows in figure 4, right panel, do not share any dependence on other fields and 
therefore can be integrated out. The field Uc^k hence only depends on external fields and can also 
be integrated out, leaving Ud^i depending only on external messages and therefore its integration 
can also be carried out with no consequences. 

This proves that the term |det(l — AJ^)| is also equal to one as |det(l — A>C)| and therefore there 
are no determinant corrections to the GBP equations on a second-level. A similar argument to the 
one used here can be applied to show that also the determinant which appear in the SP equation 
in [1, 2] is actually equal to one. Indeed on tree topologies loops are absent and the integration 
over the delta functions can be carried out with no side-effects. 
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